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COINCIDENCE  COUNTING  AND  RENEWAL  RUNS 


D.  P.  Gaver,  Jr. 

1.  Introduction  and  Problem  Description 

In  a  Stanford  technical  report,  [  £],  Zveig  describes  probability 
models  for  various  aspects  of  the  photographic  detection  process.  In 
particular,  a  model  is  postulated  for  the  process  by  which  a  chemical 
particle  (silver  halide  grain)  becomes  a  "developable  speck"  under  the 
influence  of  photons  acting  upon  it  at  random  times.  A  brief  account  of 
the  latter  physical  process  is  as  follows:  A  particle  may  be  in  one  of 
R  +  1  distinct  energy  states,  labelled,  in  order  of  increased  energy, 

S  ,  S^,  . . .  SR;  for  simplicity  these  states  will  simply  be  denoted  by  the 
integers  0,  1,  ...  R.  The  particle's  transitions  between  states  are 
induced  by  light  particles  (photons) which  impinge  upon  it;  the  time  between 
arrival  of  consecutive  photons  is  the  random  variable  a.  The  interaction 
between  the  photons  and  the  particle  is  such  that  if  the  particle  is  in 
the  lowest  en  rgy  state,  0,  then  a  new  photon  causes  it  to  jump  to  state  1. 
It  remains  there  until  either  a  temporary  activation  time,  x^,  elapses, 
or  a  new  photon  hits  it,  whichever  event  occurs  first.  If  the  temporary 
activation  time  terminates  before  another  photon  appears,  the  particle 
reverts  to  state  0.  If  the  new  photon  arrives  before  x^  after  the  first 
photon,  the  particle  jumps  to  state  2,  a  new  temporary  activation  time, 
x2,  is  initiated,  and  the  process  begins  as  if  from  scratch,  but  starting 
from  state  2.  It  is  apparently  in  accord  with  physical  understanding  to 
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postulate  that  if  a  particle  occupies  any  state  up  to  and  including  R-l 
then  transitions  will  occur  either  to  the  next  higher  state,  or  all  the 
way  back  to  0,  depending  upon  the  rapidity  with  which  one  photon  follows 
the  next.  In  contrast,  state  R  is  "absorbing",  in  the  sense  that  a 
particle  that  reaches  R  remains  there  indefinitely.  The  physical 
interpretation  of  the  latter  event  is  that  a  particle  in  state  R  is  a 
permanent  "latent  image  speck",  and  becomes  visible  if  exposed  to  develop¬ 
ment,  i.e.  chemical  treatment.  We  study  here  the  distribution  of  T  , 
the  time  until  particle  energy  first  reaches  state  R,  starting  from  state  0. 
Since  the  activation  of  the  particle  —  the  occurrence  of  a  "count"  — 
is  the  result  of  coincidence  of  the  photons,  the  process  studied  will  be 
called  coincidence  counting. 

Various  probabilistic  formulations  of  the  latter  problem  are 
possible.  That  of  [  (p  ]  is  to  suppose  that  the  photons  appear  according 
to  a  stationary  Poisson  process,  and  that  each  temporary  activation  time, 
t,  resulting  after  a  new  jump  is  an  independent  random  variable  possessing 
a  density.  Using  these  assumptions,  (  (p  J  determines  the  transform  of  the 
distribution  of  the  random  time,  T^,  described  above.  This  paper 
relaxes  the  assumptions  of  [(p],  replacing  the  assumption  of  Poisson- 
arriving  photons  by  that  of  a  general  renewal  process.  The  model  of  the 
present  paper  is  an  example  of  what  Levy  and  Smith  have  called  semi -Markov 
processes;  a  comprehensive  discussion  of  such  processes  has  been  given  by 
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Pyke  in  [  SL  ]  and  [  J  ],  and  our  results  can  be  derived  by  following  the 
latter  route.  However,  in  order  to  keep  the  exposition  self-contained 
and  to  show  clearly  all  of  the  process  components,  we  have  chosen  to 
argue  directly  and  not  to  use  the  general  theory. 

Although  the  model  outlined  above  was  developed  for  a  specific 
physical  problem,  it  has  possible  interpretations  in  other  fields.  For 
example,  it  is  tentatively  suggested  that  the  mechanism  describes  the 
process  of  learning  certain  skills.  Suppose  that  a  particular  skill 
is  only  needed  at  random  time  intervals  of  duration  a,  and  that  the  organism 
possesses  a  temporary  skill  retention  time  t.  This  means  that  in  general 
a  skill  is  retained  for  a  time  t  following  its  last  use,  but  that  if  the 
skill  is  not  required  again  during  T  it  is  forgotten  and  must  be  relearned. 

The  exception  is  that  if  a  critical  number  of  needs  for  the  skill  develop 
in  rapid  succession,  e.g.  if  B-l  uses  are  made  of  the  skill,  no  two  of 
which  in  succession  are  separated  by  more  than  t,  then  the  skill  is 
permanent,  and  will  not  be  forgotten.  Thus  the  random  variable  TQ^  represents 
the  time  until  the  skill  becomes  permanent. 

It  is  interesting  to  compare  the  model  outlined  with  the  classical 
theory  of  runs  for  Bernoulli  trials;  see  (Feller  [1  ],  p.  299  ff. ). 

If  we  define  a  renewal  run  of  length  r  to  be  an  uninterrupted  sequence  of 
inter-event  (photon  arrival)  times,  each  of  which  is  shorter  than  t,  then 
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we  are  essentially  interested  in  the  distribution  of  the  time  until  the 
termination  of  the  first  renewal  run  of  r  =  R-l.  Various  of  our  results 
are  similar  to  known  results  in  run  theory.  Details  are  given  in 
Sec.  3. 

The  present  model  may  be  modified  to  describe  energy  transitions 
down  by  only  one  step  instead  of  all  the  way  to  zero.  This  is  done  in 
Sec.  4,  assuming  that  photons  arrive  according  to  a  stationary  Poisson 
process. 


2.  A^ProbabijUtjMModel 

Let  S(t)  be  the  energy  state  of  a  particle  at  time  t;  S(t)  assumes 


the  values  0,  1,  2,  . . . ,  R. 

The  random  process  js(t),  0  <  t  <  oo  l  may  be 

specified  in  terms  of  the  time  sequence  (of  photon  arrivals)  it^,  1=1,2,.. 

as  follows 

S(t)  =  0 

for  0  <  t  <  t1 

s(v)  =  i 

(2.1) 

S(tt4) 

for  t^  <  t  <  min(t^+x^,  t^+^) 

s(t)  =  < 

S(ti+)  ♦  1 

for  ti+l  -  1  <  min(ti+Ti,ti+2^  i=1>2>--- 

0 

for  t.+T.  <  t  <  t .  . 

i  i  -  i+1 

w 

The  arrival  times  t^  (0  <  t^ 

<  tg  <  . . . )  may  be  written  as 

5- 


t 


i 


(2.2) 


is  a  renewal  process:  a  sequence  of  independently 
distributed  positive  random  variables,  identically  distributed  according 
to  the  arbitrary  distribution  function  (henceforth  abbreviated  d.f. ) 

F(*)j  F(0+)  =  Of  cij  may  be  referred  to  as  the  J-th  inter-event  time. 

Hie  momenta  of  will  be  assumed  finite.  To  simplify  the  arguments  we 
shall  take  all  temporary  activation  times  to  be  the  same:  =  t,  a 

constant  Independent  of  1.  This  assumption  may  be  relaxed,  and  the 
results  of  doing  so  will  be  mentioned  occasionally,  under  the  hypothesis 
that  is  a  sequence  of  independently  and  identically  distributed 

positive  random  variables. 

The  primary  purpose  of  the  argument  to  follow  is  to  characterize 
(by  Laplace -Stieltjes  transform)  the  d.f,  of  the  fixation,  or  absorption, 
time,  Tq^.  Hie  latter  is  the  first-passage  time  from  State  0  to  State  R: 

Tqr  =  min( t:  S(0)  =  0,  S(t)  =  R)  .  (2.5) 


where 


jdj, 


It  will  then  be  possible  to  derive  moments  of  the  latter  time,  and,  at 

least  in  principle,  to  exhibit  the  explicit  d.f.  of  T  .  In  the  course  of 

OR 

the  derivation  to  be  given  it  is  convenient,  and  possibly  informative,  to 
examine  some  auxiliary  events  and  random  variables.  Hiese  will  be 
introduced  in  what  follows,  and  a  final  synthesis  made  to  find  the  d.f.  of  T 
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(a)  Pre -absorption  energy  maxima 

Prior  to  the  time  TQR,  at  which  absorption  occurs,  the  particle 
may  visit  each  of  the  intervening  states  0,  1,  R-l  a  number  of  times, 

each  time  dropping  to  0  and  starting  afresh  before  finally  reaching  R. 
Following  each  return  to  0  the  particle  eventually  jumps  to  1.  Features 
of  the  particle's  sojourn  in  States  1,2,  ...,R-1  will  be  treated  here  first. 

Let  t(l;k)  denote  the  photon  arrival  time  immediately  following 
which  the  particle  is  in  state  1  for  the  k-th  time.  Thus,  in  terras  of 
jtA,  see  (2.2), 

t(ljl)  =  tx  (2.4) 

t(ljk+l)  =  min  |t^j  >  t(l;k)  and  S(tj  +  )  =  lV. 

Let  An(k)  denote  the  event  that  the  particle  reaches  state  n,  but  not  n+1, 
following  t(ljk).  Then 

pn(lc)  =  PfVlc)]  =  PtM(lc)  =  a]i  (2*5) 

where 

M(k)  =  max  S(t)  (2.6) 

t(l;k)<t<t(l;k+l) 

It  follows  from  (2.1)  and  the  independence  and  identical  distribution  of 
the  inter-event  times  that 
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P„(K) 

Vk) 


P[Oj(k)  <  t]  P[a^(k)  >  t)  =  [F(t)J 

P Cci J ( lc )  <  T]  =  (F(T)f'1 


n-1 


[l-F(t) 


], 


11=1,  9  9  9  jR-1 


(2.7) 


where  a.  (k)  denotes  the  J-th  Inter-arrival  time  following  ;(ljk). 

0 

If  is  a  sequence  of  positive  independent  random  variables 
with  d. f.  G(*)f  then  (2.7)  is  replaced  by 


Pn(k>  *  tFojD "1[1'F0)  n  -  1,2,...,R-1 

PB(k>  =  [FaJR'1 

where 

oo 

Fq  =  F  (l-G(x) ]dF(x) 


(2.8) 


(2.9) 


Since  R 

I  Pn(k) 
n=l 


1, 


(2.10) 


absorption  in  state  R  occurs  after  t(ljl),  t(l$2), . .  .t(l;k),. . .  Each  time 
particle  energy  reaches  state  1  an  independent  trial  occurs  —  one  that 
culminates  either  in  absorption  in  R,  or  in  return  to  0  and  a  new  start 
after  reaching  state  1  again.  Letting  K  denote  the  trial  number  on  which 
absorption  occurs,  we  have  from  the  above  that 

P[K=j]  =  (l-F^"1)^"1  F^"1)  J=lj2, . . . j 

E[K]  =  F1”^ 


(2.11) 
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Finally,  let  M(k)  be  the  conditional  random  variable  which  equals 
M(k)  given  that  the  latter  is  not  greater  than  R-l;  M  is  a  pre-absorption 
energy  maximum.  Clearly 


P(M(k)=n]  =  P[M(k)=n|M(k)  <  R-l]  =  P[M(k)=n|K  >k] 


n=l f 2, . . . ,R-1 


(2.12) 


(b)  Activation  periods 

It  is  useful  to  define  the  duration  of  an  Incomplete  activation 


period: 


I(k)  =  inf 


=  inf 


S(t(l;k)  +  t) 


0, 


t  <  GO 


} 


S( t(ljk)  +  t)  =  0,  k  <  K 


(2.13) 


l(k)  is  a  random  variable  representing  the  period  of  time  that  elapses 

from  an  instant  (the  k-th  such)  immediately  following  which  S  =  1  until 

the  energy  state  next  drops  to  0,  having  avoided  absorption  at  R.  In 

terms  of  our  inter-event  times,  and  temporary  activation  times, 

M(k)-1 

I(k)  =  y  3j(k)  +  t  (2.1k) 

J=1 

where  P.(k)  is  the  duration  of  the  j-th  inter-event  time  following  t(l;k), 
J 

given  that  the  inter-event  time  is  shorter  than  the  temporary  activation 
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time  ^ •  hence  the  sum  is  to  be  interpreted  as  zero  if  M(k)  =  1.  We  have 


P[Pj  <  x] 


0  <  X  <  T 


(2.15) 


T  <  X, 


E [e  J ]  = 


f  e'SXdF(x) 


fUll 

F(t) 


(2.16) 


We  shall  later  require  a  random  variable,  7,  bearing  relation  to  the 
inter-event  time  a  in  a  manner  complementary  to  6;  7^  is  the  excess  of 
the  duration  of  the  first  inter-event  time  following  t(l;k)  which  is 
longer  than  the  corresponding  temporary  activation  time.  Its  distribution 


P(rk<x]  -  (T)-  ■  °<* 


(2.17) 


-87,  ST 

E[e  k]  =  — 


e"SXdF(x] 


1-F(t) 


(2.18) 


The  Laplace-Stieltjes  transform  of  the  d.  f .  of  l(k)  may  be  written  down 

directly,  using  conditional  expectations: 

n-1 

E[e”sl(^  |M(k)=n]  =  exp[-st  +  s  ^  3^  ]  n  =  1,2,...,R-1 


*/  v  n-1 
■  *'ST  ^ 


(2.19) 
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Now  use  (2.11)  to  remove  the  condition: 


E[e-8l(k),  =  J  E[e-Sl(k)|M(k)  nJ 

n=l 


n-i 

•7 


n-1 

) 


Fn~1(l-F) 
1-F^”1  * 


(2.20) 


'”U-F)  fl-[F(s|T)lR'X  1 
l-F^"1  I  I-F(s)t)  J 


In  the  event  that 


W 


is  a  sequence  of  independent  r.v,  then 


«[.*■«*>]  . 


oo 

e-SX[l-F(x) JdG(x) 


1-F 


R-l 

G 


(2.21) 

this  latter  expression  follows  by  conditioning  according  to  the  values  of 

t  as  well  as  M.  It  can  be  seen  to  reduce  to  (2.20)  when  0(x)  is 
J 

degenerate,  concentrating  at  t. 
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A  complete  activation  period;  C,  is  defined  as  follows: 


C  = 


infjt: 


S(t(l,K)  + 


(2.22) 


C  is  the  time  required  for  the  energy  level  to  pass  from  state  1  to  R 
vithout  any  intervening  sojourns  in  state  0.  Alternatively  C  may  be 
expressed  as 


R-l 

Bji  (2.2?) 

J"1 


it  then  follows  immediately  that 

<*,  \  R-l 

rF(s-lT) 


E[e'sC]  = 


(2.24) 


In  the  event  that  -j  t  l  are  distributed  according  to  G('), 

1  Jr  oo 


E[<='SC]  = 


7. 


e‘SX(l-G(x))dF(x)  R“1 


(2.25) 


(c )  First-passage  time,  TQ^ 

Using  the  ingredients  described  above  it  is  seen  that  the 

desired  first-passage  time  may  be  expressed  as 

K-l 

tor  =  «i  +  Y  [v  i(k)]  +  c  (2,26) 

j-o 

Given  the  value  of  K,  is  seen  to  be  a  sum  of  independent  random 
variables,  30 
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-sT 

E[e  0R|K=k]  =  E(e'8a)[E(e"87)E(e’8l)]k'1  e"sC. 

When  one  removes  the  condition  by  use  of  (2.11): 

-sT  -sT 

E[e  0R]  =  2  E(e  °R|K=k]  P[K=k] 

k=l 


(2.27) 


(2.28) 


the  result  is,  after  substituting  and  summing  the  geometric  series, 


E[e 


E(e~SQ)  E(e~3C)  F^"1 
l-E(e‘87)E(e'Sl)(l-FR'1) 


(2.29) 


If  the  previously  obtained  expressions  for  the  component  expectations 
are  substituted  and  some  simplification  made. 


-sT 

E[e  0R] 


oo 


U 


e”SX  dF(x) 


1. 


e'SX  d*(x) 


lR-1 


(2.30) 


1  - 


r  1  -  iJJ  e‘8XdF(x)  f'1 
e  dF(x)  i 


oo 

n 

-3X 


x.r.- 


sx 


dF(x) 


3.  Some  Expected  Values  and  a  Limiting  Distribution 

The  various  component  probability  distributions  and  transforms 
derived  in  (a),  (b),  and  culminating  in  (2.30)  of  (c)  above, 
solve  in  principle  the  problem  posed.  In  order  to  help  the  intuition  in 
dealing  with  these  expressions  a  few  expectations  will  be  presented. 
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Also  ,  a  limiting  distribution  for  T  will  be  derived. 

On 


A.  Moments 

Expressions  (2.5)  and  (2.8)  give  the  probability  distribution  of 
the  random  variable  M(k):  the  maximum  state  reached  in  a  single  (the  k-th) 
sojourn  in  positive  states.  The  generating  function  of  M(k)  is  easily 
computed  from  (2.8),  and  from  it 

1_fg 

E(M(k))  =  ;  (3.1) 

i_FG 

clearly  the  latter  approaches  R  as  F  increases,  as  it  should. 

G 

Since  the  trial  number,  K,  on  which  absorption  occurs  is  again 
geometrically  distributed,  by  (2.11),  a  generating  function  is  immediately 
obtained;  from  this,  or  directly, 

E[K]  =  f£'R  (3.2) 


Similarly,  the  expected  single-trial  pre-absorption  energy  maximum 
M(k),  has  a  truncated  geometric  distribution,  (2.12),  and 


1  -  R  f^"1  +  (R-1)f£ 

(1-Fj.K1-^-1) 


(5.3) 


From  (2.11)  and  (2.12)  another  piece  of  supplementary  information  is 
available:  the  distribution  of  highest  state  reached  before  absorption 
in  state  R,  This  is  simply  the  d.  f .  of  the  unconditional  pre-absorption 
energy  maximum,  denoted  by  FL  when  absorption  level  is  R. 


A  conditional  argument  gives 


14. 


and  the  first  moment  is 


n  =  0,1,..., R-l 


(3.4) 


(3.5) 


Finally,  differentiation  of  (2.30)  gives  the  expected  value  of 
the  first-passage  time: 


E(T0B> 


(5.6) 


B.  Limiting  Exponential  Distribution  for  TQp 

It  is  apparent  that  E(Tqr)  increases  with  R,  and  with  decreases 
in  Fg;  for  fixed  F  the  latter  behavior  occurs  if  r  becomes  small  or  if 
G(‘)  concentrates  near  zero.  It  is  of  interest  to  establish  a  limiting 
distribution  for  the  scaled  random  variable 

T*  =  T  [E(T  Jf1 
OR  OR  1  '  0R/J  * 

It  will  now  be  shown  that  under  general  conditions 

P{Tor  <  t  E(T0r)}  ~ >  l  -  e  1  for  t  >  0  (3.7) 


as  E(Tqr) 


*  oo  . 
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Verification  of  (5.7)  follows  from  (2.29)  and  the  continuity 
theorem  for  characteristic  functions.  The  characteristic  function  of 


T*  =  T  [E(T  ) 1 
OR  OR1  'or11 


-1 


is  obtained  from  (2.29)  by  simply  replacing  s  by 


-itwvr1. 


Now  it  is  easy  to  see  (for  example,  from  (2.25),  (2.14),  and  (2.15)) 
that  the  random  variables  C  and  I  are  with  probability  one,  both  bounded 
above  by  (R-1)t.  From  this  it  follows  that 


C[E(T  n*1  <  (R-l )t  F^x)  (5.8) 

1-F  (t) 

and,  since  we  are  assuming  that  0  <  F(t)  <1  for  x  >  0,  the  right  hand  side 
tends  to  zero  as  either  R  — >  oo  or  x  — >  0,  hence 

E  exp( i£C [E(TqR) ]”X)  — >  1, 

uniformly  in  any  finite  ^-interval  enclosing  the  origin.  Similarly, 

E  exp(iea[E(T0R)]"X)  — >  1. 

Next, 


li(exp  U  rlECT^)]'1)  .1+15  EtrJIStTgp)]'1  +  r^t) 

and  (5.9) 

E(exp  ii  I[E(Tqr)  ]_1)  =  1  H  E(I)[E(Tor)]"1  +  r2U), 


16. 


where  the  remainders  r^(£)  and  r^(5)  are  bounded  in  absolute  value: 


|ri(5>| 

k2U)| 


(p(t)]2( H.i) 

(E(Toh)  ]  E  (a) 

2  (R-1)V[F(T)]2(R~2)[1-F(t)l2  _ 
E2(a)  (l-F^t))2 


U-F(t)] 

[i-fV))2 


(-5-10) 


Note  that  |r^(0|  and  |  r^( 4 )  |  both  tend  uniformly  to  zero  for  all  £  in 
any  finite  interval  enclosing  the  origin  as  either  R  — >  oo  for  fixed 
t  >  0,  or  t  — >  0  for  fixed  R  >  2.  It  then  follows  by  expanding  the 
denominator  of  (2.29)  and  using  (3.9)  and  (3.10) 


E  exp( t0R(e(TqR)J  )  >  l-i^  * 


(3.11) 


the  characteristic  function  of  the  exponential  distribution  with  unit 
mean,  as  E(Tqr)  — ^  ao,  where  the  latter  limit  is  the  result  of  either 
letting  R  — >  oo  for  t  fixed,  or  t  — >  0  for  any  fixed  R  >  2.  By  the 
continuity  theorem  for  characteristic  functions,  (3.7)  follows. 

The  above  result  suggests  that  if  we  modify  the  model  so  that 
when  state  R  is  reached  the  process  state  immediately  reverts  to  zero, 
from  which  point  the  process  starts  over,  then  the  distribution  of  the 
number  of  renewal  runs  of  length  R-l  accumulated  in  time  t'  =  t  E(T^P) 

ui. 

tends  to  the  Poisson: 


n  -  0, 1,2, .  . . 


(3.12) 
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aa  either  R  — >  co  or  t  — >  0  . 

The  strong  resemblance  between  the  present  renewal  run  process 
and  classical  runs  in  Bernoulli  trials  has  been  mentioned  earlier. 

Let  the  event  that  an  inter-event  time  a  is  less  than  the  corresponding 
temporary  activation  time  t  be  called  a  "success",  and  the  complemer tary 
event  a  failure,  so  F(t)  or  F  is  the  probability  of  a  "success".  Then 
if  the  renewal  run  process  is  started  from  state  1  the  expected  time  until 
a  run  of  length  r=R-l  occurs  is,  from  (3.6), 

F~^-l  i_pr 

E(T.  J  =  E(a)  •  - - E(a)  =  E(a)  •  — - —  ,  (3.13  ) 

1  F'1  -1 

and  if  E(a)  =  1  this  is  tho  expected  recurrence  time  of  runs  of  length  r, 
as  given  by  Feller  ( [  1  ],  (7.7)  p.  300).  Similarly,  if  we  consider  the 
model,  modified  as  described  above  by  throwing  away  the  initial  time  to  go 
from  0  to  1,  our  previous  argument  shows  that 

p{tib  s  *  E(V  }  1  -  O.IK) 

as  R  — >  oo,  and  consequently  the  distribution  of  the  number  of  renewal 
runs  in  time  t'  =  t  E(T^)  tends  to  the  Poisson  with  unit  mean.  This 
result  is  entirely  comparable  to  the  Poisson  distribution  for  long  runs 
in  Bernoulli  trials;  see  Feller  (  (  1  ],  p.  310,  problems  25  and  26). 
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4.  AModyyTiedModel 

The  model  for  energy  state  transitions  specified  by  (2.1)  permits 
state  Jumps  either  up  by  one  unit,  or  down  to  state  0,  As  an  alternative 
one  may  contemplate  a  process  that  permits  transitions  either  up  or  down 
by  one  unit.  Transition  up  by  one  unit  is  the  result  of  a  photon  arrival; 
transition  down  by  one  unit  occurs  if  no  new  arrival  has  occurred  for  a 
(random  and  independent)  time  period  t  that  begins  immediately  after  the 
last  transition,  whether  the  latter  was  up  or  down;  no  down  transitions 
are  permitted  from  state  0,  however. 

Analysis  of  the  process  described  is  difficult  for  generally 
distributed  inter-event  times,  a,  because  of  the  absence  of  convenient 
regenerative  properties  when  down  Jumps  occur.  In  our  earlier  model  a 
down  Jump  always  terminated  at  zero.  Analysis  of  the  present  model  Is 
rendered  complex  because  the  distribution  of  the  excess  occurring  on  the 
occasion  of  a  downjump  in  gmeral  depends  upon  details  such  as  the  number 
of  down  Jumps  following  the  last  arrival. 

If,  however,  we  consider  the  special  case  of  stationary  Poisson 
photon  arrivals  --  perhaps  the  most  plausible  physical  assumption  in  any 
case  —  the  above  difficulty  vanishes  because  of  the  characteristic 
memoryless  property  of  the  Poisson.  When  the  latter  is  in  effect 


X  >  0 
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denote  the  exponential  d. f.  of  a,  a  generic  inter-event  time.  If 

j"t*,  i  =  1,2, . . .  is  the  sequence  of  times  at  which  transitions  --  either 

unit  up  or  down  Jumps  --  occur,  then 


■  p{s(t;+i 


,0D 


+  )  -  k-tl|s(t 


=  f  i 


[l-G(x)  ]e"^X  Xdx 


(4.2) 


f°° 

qk  =  p|s(tj+1  +)  =  k-l|S(t'+)  =  k |  =  J  e_Xx  dG(x) 


where  p  -  1,  p  +q  =  1.  In  words,  p  is  the  probability  that  a  transition 
U  K.  1C  K, 

is  an  up  Jump,  and  q  the  probability  that  it  is  down.  For  the  present 

1C 

process  the  probabilities  p  and  q  are  independent  of  It,  but  this  need 

1C  K 

not  be  true  in  general.  We  shall  also  be  interested  in  .the  sojourn  times 
of  the  process  in  the  various  states:  an  up  sojourn  time,  S^,  is  the 
time  spent  in  state  k,  given  that  the  next  transition  is  to  k+lj  a  down 
sojourn  time,  S^#  is  the  time  spent  in  k,  given  that  the  next 

1C 

transition  is  to  k-1.  Ihe  distribution  functions  of  these  variables  are 


Uk(z)  =  P[S^u)<  z]  s  P[tJ+1-tJ  <  z|s( t’  +)  =  k,  S(tJ+1  +)  =  k+1] 
Dk(z)  =  P[S^d)<  z]  ^  P[tJ+1-tJ  <  z|s(t’  +  )  =  k,  S(tJ+1+)  =  k-1]. 


(4.3) 


In  the  present  model 


r 

J  [l-G(x)  je'^kdx 

U.  (z)  =  - - 

k^  '  ,-cu 

[1-G(x)]e  ^Xdx 

0 


(4.4) 


?o. 


Vz) 


G(x) 


G(x) 


# 


A  process  of  the  type  described  may  be  called  a  semi-Markov 
birth  and  death  process;  cf.  Pyke  [j  ],  [J  )  and  Smith  [S  )>  for  formal 
definition  of  the  general  S.-M.P.  For  present  purposes  it  is  sufficient 
to  remark  that  the  time  to  absorption  in  state  R  may  be  expressed  as 
follows  for  the  S.-M.  birth  and  death  process: 


=  +  A,  +  . . .  + 


"OR  '  "Q  -  Vi 

where  is 

passage  time  from  state  k  to  state  k-tl: 


(4.5) 


sequence  of  independent  random  variables;  A  is  the  first- 


A^  =  infjt:  S(t^+t)  =  k+1,  given  S(tJ+)  =  kj-  . 


(4.6) 


From  the  regenerative  property  of  the  process  it  is  evident  that  A^  may 
usefully  be  expressed  as 


J 

\  =  J  [S[d>(n)  4  SkU>(J+1) 

n=0 


(4.7) 


where 


is  the  sequence  of  independent  and  identically  distributed 
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sojourn  durations  In  state  k  that  terminate  in  transition  down  to  k-lj 
Ik  l^nM  *8  ttie  corre8P°ndin6  sequence  of  independently  and  identically 
distributed  first-passage  times  up  from  k-1  to  kj  '  is  the  duration 
of  the  final  sojourn  in  k  leading  to  transition  up  to  k+lj  J  is  the 
random  number  of  sojourns  terminating  in  down  transitions  before  the 


eventual.  Jump  up  to  J+l.  Now  if  we  condition  on  J  we  have  by  independence, 

•8V  ~M) 


E[e 


|J)  -  {: 


-aS'“'  -sA.  ,  y  -3s[u) 
E[e  k  ]  E[e  k'1]jE[e  k  ] 


»  {^(o)  E[e  k'1)juic(=) 


(4.8) 


where  U^Cs)  and  D^vs)  represent  the  Laplace -Stieltjes  transforms  of 

U.  (x)  and  D,(x).  Since 
k  k 


removal  of  the  condition  on  J  leads  to 


(M) 


"aAk 

E[e  K]  = 


pk  °it(8) 


r-  "8\-l 

1  -  Dk(s)  E[e  K  X] 


(^.10) 


Since  there  are  no  down  Jumps  from  k  =  0,  is  simply  the  duration  of 

the  sojourn  in  state  0,  presumed  known.  Hence  in  principle  one  may 

■9Ak 

proceed  by  induction  to  find  E[e  ]  explicitly.  Finally,  by  independence 
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-sTa_  R-l  -sA, 

B[e  “j  =  ]]  E[e  k]  . 

k=0 


(4.11) 


Observe  that  all  of  the  above  formulas  specialize  easily  to  simple  random 
walks  and  birth-and  death  processes  by  appropriate  choice  of  sojourn 
distributions.  In  the  latter  cases  they  provide  convenient  means  for 
computing  first-passage  times  in  queues,  etc. 

The  expression  (4. 10)  may  be  differentiated  bo  generate  moments 
of  the  moments  of  may  similarly  be  expressed  in  terms  of  the 
latter  by  way  of  (4.11).  We  have  in  general 

(4.12) 


E<V  * 


E'V  \  "'-Vi1  Vk-i  e[sk-2]  Vk-r--qi 


pk  pk  pk-l  pkPk-l  pk-2 


+  •  •  • 


P„P 


k±vr*,*i 


P,  E[V 


where 


B(3k)  =  ^  E[3^U)J  +  ^  E(S^d)) 


(4.15) 


Returning  now  to  our  physical  model  we  note  from  (4.2)  and  (4.4)  that  p 

r 

and  E[S  ]  are  independent  of  k.  In  fact 

Iw 


pk  =  1-0(1),  q^  =  G(\) 


E(3k]  - 


k=l,2, . . . 


Po”1'  Efso]  -  X  • 
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From  (4.12)  there  results 
E[A0)  =  X 

E[\]  =  X 


and  finally  by  summation 


(4.14) 


(4.15) 
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